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Abstract 

We show that the dynamical order parameters can be reexpressed in terms 
of the distribution of the staggered auto-correlation and response functions. 
We calculate these distributions for the out of equilibrium dynamics of the 
Sherrington-Kirpatrick model at long times. The results suggest that the 
landscape this model visits at different long times in an out of equilibrium 
relaxation process is, in a sense, self-similar. Furthermore, there is a simi- 
larity between the landscape seen out of equilibrium at long times and the 
equilibrium landscape. 

The calculation is greatly simplified by making use of the superspace no- 
tation in the dynamical approach. This notation also highlights the rather 
mysterious formal connection between the dynamical and replica approaches. 

We also perform numerical simulations which show good agreement with 
the analytical results for the out of equilibrium dynamics. 



*Address after October 1st: Service de Physique de l'Etat Condense, CEA, Saclay, France. 
^ Address after October 1st: LPTHE, Ecole Normale Superieure, Paris, France. 

1 



I. INTRODUCTION 



The partition function of mean-field spin-glasses is dominated by many states. The geo- 
metrical organization of these states, their relative weights in the Gibbs-Boltzmann measure, 
and the distribution of their mutual distances have been known for some time [|],[|]. Of par- 
ticular importance is the functional order parameter P(q) giving the probability distribution 
of states with mutual overlap q. 

The Gibbs-Boltzmann measure can be studied analytically using a dynamical approach 
0. For instance, the Langevin Dynamics 

T o 1 ^(t) = -p^ f) +m (i.i) 

(r determines the time scale and £j(£) is a Gaussian white noise with zero mean and variance 
2), with the following order of large times and large N limits 

lim lim , (1.2) 

N^oo t— >oo 

guarantees ergodicity and leads the system to equilibrium. The equilibrium thermody- 
namical values of any operator O are then obtained as averages over the noise (0) eq = 
limAr^oo hm t _ +0O (0(t)). 



A different situation, closer to the experimental settings, is to consider the relaxation of 
an infinite system at long but finite times. The time is measured from the initial time - the 
quenching time in experiments - which we take as zero. The order of limits is then 

lim lim . (1.3) 

An analytical solution for mean-field spin-glasses in this regime has been recently de- 
veloped It was there argued that in regime (|1.3| ) mean-field spin-glass systems below 
the critical temperature never achieve equilibrium, not even within a restricted sector of 
phase-space. This is in agreement with experimental spin-glasses, for which the estimate is 
that aging effects take a few years to die away |§. 
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A relevant order parameter for the long-time asymptotics of the relaxation is the dy- 
namical Pd(q) defined as follows [|J: We add time-independent source terms /i^...^ to the 
energy 



(Tl 



1 N 

H h = H + E Kx...i T o% x ■■■< 

il,...,i r 

and then consider the generating functions of the generalized susceptibilities 

Lim 



(1.4) 



— y 



d< s h (t) . . . s ir (t) > 



dh h . 



h=0- 



l dq ^^ q = L dqP ^ q)q ■ 



;i.5) 



If the sysmbol Lim stands for (|T2|), it defines the usual Parisi order parameters x(q) and 
P(q) [0]. If it stands for ( |1.3| ) then Eq. flOp defines the dynamical parameters Xd(q) and 
Pd{q) I- 

The dynamical order parameters Xd{q) and Pd{q) - unlike their static counterparts - have 
not as yet been given a probabilistic interpretation. The main purpose of this paper is to 
show that Pd(q) can be recast into a form that: 

i. Makes its physical meaning more explicit. 

ii. Shows for the Sherrington-Kirkpatrick (SK) model that their is a self-similarity in the 
landscape. Although at all long but finite times (limit (p3|)) the system is exploring regions 
of phase-space which it will eventually leave, never to return, some geometrical properties 
of these regions coincide with those of the equilibrium states. 

Hi. Is amenable to numerical simulations. 



The Hamiltonian of the Sherrington-Kirpatrick model is given by 

H ^ = a7 E J Wi + a E ^ - X ) 2 • (1-6) 

ij i 

The interactions Jij are quenched random variables Gaussianly distributed with zero mean 
and variance 1/vJV. The last is a spin weight term and the hard- spin limit (±1) is recovered 
taking a — » 00. 
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The out of equilibrium dynamics of the SK model has been studied in Ref. 0. A 
surprising outcome, obtained under a set of hypothesis described there in detail, is that the 
dynamical order parameters Pd{q) and Xd(q) coincide with the static order parameters P(q) 
and X(q) - even if the physical situations they describe are very different. The coincidence 
of dynamical and static order parameters does not hold for every model, for instance the 
p-spin spherical model behaves in a different way ||. 

We shall use in this paper the results of Ref. H to compute analytically the staggered 
auto-correlation and response functions §JT^| in the limit of any two large times (limit (|L3|)) 



for the SK model. All the information about the asymptotic large times solution is encoded in 
the order parameter Xd{q) and in the 'triangle relation' / relating the correlation functions 
at any three long times (see Ref. 0). We shall then compare analytical and numerical 
results for the staggered distributions. Their good agreement gives numerical support for 
the predicted equality of dynamical and static order parameters in this case. 

In order to obtain the staggered distributions from X^{q) (or Pd{q)) arid / we shall heavily 
use the formal relation between the static replica approach and the dynamical approach, 
which becomes transparent when the latter is formulated in terms of superspace variables 
PH , P^| . (Although the underlying supersymmetry in this dynamics is partially broken by 
the 'boundary' - initial - conditions, it still has useful consequences.) 

This proceeds in two steps: we firstly identify the dynamical - superspace - counterparts 
of the static - replica space - variables. We obtain, roughly speaking, the same formulae 
with superspace integrals - including a time-integral - substituting sums over replicas. 

Secondly, we look for the solution for the dynamical order parameter. Again, this solution 
has many points in common with the solution for the statics although they are not equivalent 
for every model and describe entirely different physical situations. 

The paper is organised as follows. In Section [II] we introduce the staggered distributions. 
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Using the SUSY formalism, we find that they are related to the powers of the dynamical 
order parameter Q(l, 2). In Section [TTI| we compute, in general, these powers of Q(l, 2) and 
then specialise to the long-time asymptotics of the SK model using the results of Ref . || . In 
Section |IV| we obtain the staggered auto-correlation function for large times. In Section [V] 
we describe the numerical simulations and compare them to the analytical results. Finally, 



we discuss the physical picture in Section VI 



II. STAGGERED DISTRIBUTION FUNCTIONS 



The staggered auto-correlation function is defined as 

g{\-MM) = M*i) <r A (t 2 )> = £>|i) ( A b'> a i&)) ■ ( IL1 ) 

A denotes the eigenvalues of the N x N random matrix associated with the eigenvectors 
|A). \cr(t)) is the time-dependent iV-dimensional vector of spins, (Ti(t) = (i\a(t)), and a\(t) = 
(\\a(t)) are the staggered spin states. 
The staggered response function is 

« A *-H^}=? W < AW <£8>- (IL2) 

The functions g and g are in turn related to the set of time-dependent two-point functions 

ij 



^ ((l , i2 )4 E ( (J% M|)), (n.4) 

where ~ represents the mean over the quenched disorder. In terms of g and g they read 

E<- k \t u t 2 ) = J d\p(\)\ k g{\-M,t 2 ) , (H.5) 
i( fc )(t 1; t 2 ) = J dXp(X)X k g(X;t l ,t 2 ) . (II.6) 



p(X) is the eigenvalue distribution that, in the limit of large N, corresponds to the semicircle 
law p(X) = 1/(2tt) V4- A 2 if the variance of the is finite ||13|| . In particular, if t\ = 
and k — 1 Eq. ( |11.5| ) gives the time-dependent energy density. 



A. Supersymmetric Formalism 



Following Ref. |TT| we introduce the supersymmetric 'field' 0j(l), i = 1, ■ ■ ■ , N, 



0,(1) = ai{t x ) + 7fc(ti) 0i + 0i ^(ti) + o-i^) 0i0i (II.7) 

with 1 = (ti,0i,0i). 

The dynamical expectation value of a quantity O can then be written as 



(0(ti)) = j TUDfa] OitJexpi-SiciN ~ Spot] 

s KIN = r- 1 / dedodt J2 d(t>i [d4>l ° d(t> * 



89 \ 86 8t 

S POT = p I dOdOdt H{4>) . (II.8) 



As in the static replica approach, once the mean is taken over the couplings one ends up with 
a functional of the order parameters that can be calculated by saddle point. The dynamical 
order parameter is the 'supercorrelation' function defined as 

0(1,2) = ^(1)^(2)) (II.9) 

% 

that plays the same role as Q a b in the statics. For the mean-field case that satisfies causality 
the saddle-point value of Q(l, 2) can be written as 

Q(l,2)=C(ti,t 2 ) + (0 2 -0i) [0 2 G(ti,t 2 ) + 1 G{t 2 M)\ (H.10) 

and it encodes the two-time functions C and G that are the stantard auto-correlation and 
response functions 



cXM2) = ^^>i(*iW* 2 )>, (mi) 

respectively. Because of causality, G(t±, t 2 ) — if t 2 > t\. In these formula? we have ommited 
the mean over the disorder since C and G are self-averaging in the limit N —>■ oo for finite 
times as can be easily proven by considering the evolution of two independent copies of the 
system with the same couplings J^. 

We shall need the definition of the operator powers of Q 

Q k (l, 3) = J d2 Q k -\l, 2) Q(2, 3) . (11.13) 

It is easy to see that Q conserves the form flTUOD with and given inductively by 



C^(t 1 ,t 3 ) = j dt 2 [C^ k - 1 \t 1 M)G{hM) + G^- 1 \t 1 M)C{t 2 M)\ , (H.14) 
G (k \h,t 3 ) = J dt 2 G^it^Git^h) , (11.15) 

ti > t 3 . From now on supra- indices within parenthesis denote entries in the function Q k 
while supra-indices without parenthesis denote ordinary powers. 



B. Staggered auto-correlation and response functions 



We now start the computation of the staggered auto-correlations and responses. With 
the superspace notation most of the manipulations of Ref . [[H]] carry through without change, 
just substituting replica indices by superspace variables. Defining 



E {k) (1,2) = E {k \t u t 2 



0i) \e 2 E^(t 1 ,t 2 ) + e 1 E^ k \t 2 ,t 1 ) 



(11.16) 



we have that 
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^ (fe) (l,2) = ^(0 i (l)(J%0,(2)), 



(n.i7) 



here '( • )' denotes mean with the measure ( [II. 8| ). Correspondingly, the staggered distribu- 
tions can be encoded as 



flf(A; 1, 2) = g(X; h, t 2 ) + (9 2 - 9 J [6 2 g(X; t u t 2 ) + 9 1 g{\; t 2 , t x ) 



(11.18) 



We shall use a related set of order parameters [] 

k 

X( k \l,2) = J2 S ^E (r \l,2), (11.19) 

r=0 

where S k (z) = Ylt=o $k,r z r are the Chebyshev polynomials of the second kind, generated by 

oo 1 

^ (1-yz + y 2 ) 

In components, Af^(l,2) reads 



2) = A-«(t 1; t 2 ) + (0 2 - 00 [0 2 t 2 ) + 1 #( fc >(t 2 ,t 1 



f 11.21^ 



Following exactly the same steps as in Ref. p0| , one gets 

-2 



2) = i | dX yjl - ^ 5*(A) 0(A; 1, 2) 



(11.22) 



z.e. each component and is the coefficient of the expansion of g and g in the 
polynomials S k - 

One can now show ITOl that the X^ are obtained from 



Af (fc) (l,2) =(3 k Q fc+1 (l,2) , 
or disentagling the superspace notation 

*<*>(ti, t 2 ) = ^ T dA ^i-^s k (X) g{\;hM) 



(11.23) 



# (fc) (*i,* 2 



-2 
2 



1 /" z / A 2 
- J dXyJl- — S k (X) g{X;t u t 2 ) 



(3 k C^ k+1 \t u t 2 ) 
f3 k G^ l \t u t 2 ) 



(11.24) 
(11.25) 



1 The functions X^ k \l, 2) are the dynamical analogs of the functions X k of Ref. 



We are left with the task of calculating the powers of the superorder parameter Q. Before 
dealing with this, let us give a compact form for g; using Eq. ( |11.20| ) and the orthogonality 
properties of the Chebyshev polynomials we obtain 



6(1 - 2) = (0 2 - 6i){0 2 - 9i)5(t 2 - h). The relation ( gL26[) is valid for all times. It is 
purely a consequence of the mean- field limit and the (super) symmetries of the problem, we 
have not yet used at all the dynamical solution. 

In the following sections we shall concentrate on the long-times regime ([Q|). We shall 
express the results rather than in terms of the times, in terms of the value the auto-correlation 
function takes at those times. 



We now calculate the powers Q k for large times. Until explicitly noted our calculation 



0(A;1,2)= Q(S-(3\Q + (3 2 Q 2 ) (1,2). 



(11.26) 



Products and inverses are as in Eq. 



( [11.131 ) and the identity is defined as 



III. POWERS OF Q 



is not particular to the SK model but only relies on the assumptions made in Ref. |J for 



the long times dynamics of mean-field spin-glasses. 



For any three large times the auto-correlations satisfy 'triangle relations': 




(III.l) 



The function / is an associative composition law. 



We also have that 



G{h,t 2 ) 



dF[C(t u t 2 )} 
dt 2 



*d[C(ti,t 2 )] 



dC(t u t 2 ) 
dt 2 



(III.2) 
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Eq. ( |III.2|) define Xd[C] and F[C] (the latter up to a constant). It says that the violation 
of the FDT theorem for the non-equilibrium dynamics of spin-glasses is determined by a 
function X^[C] that depends on the times exclusively through C(ti,t 2 ). 

This scenario has been proposed to analyse the large-times dynamics of the mean-field 
spin-glass models. The solution of the dynamical problem for a particular model gives 
explicit expressions for Xj, F and / @H. 



In the Appendices we shall show that the structure ( |111.1| )-( [I11.2| ) carries through to 
Q k . The reasoning is general and does not depend on the model. The main steps are the 
following: We first show that C^ k ' depends on the times only through C(ti,t 2 ) : 

CW(t 1 ,t 2 )=CM[C(t 1 ,t 2 )] (III.3) 

The triangle relation for C^ k > can be read from 

C(G \t max ,t m i n )) = f (C(C^ k (t max ,ti n t)),C(C^ \ti n t, train))') > (IH-^) 

i.e. the new triangle relation is isomorphic to the old one. 



Relation ( |III.2| ) then maps into 



In the Appendices we also show for the SK model that is obtained through 



(III.5) 



xf\C^[C]) =X d [C] . (III.6) 



Of particular importance are the values of the correlations C = a* that are 'fixed points' 
of/ 

f(a*,a*) = a*. (111.7) 
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Equation ( |III.4| ) implies that fixed points corresponding to C are mapped into fixed points 
corresponding to C^ k \ 

The fixed points separate the range of auto-correlations in 'discrete scales' |J. Under 
very general (model independent) assumptions, the relation / between two fixed points is 
ultrametrical 

/(a*, a*) = min(a* , a*) (III.8) 

but not so the relation between values of the auto-correlation that are not fixed points and 
belong to the same discrete scale. 

In general, it turns out that the function C^ k \C), when evaluated in the fixed points a* 
is related to the ultrametric ansatz in replica space as follows: Let Q a b be an ultrametric 
matrix with elements q r associated with blocks of sizes X r . We compute the matrix power 
[Q fc ]a6, and consider its elements (say, g£ ) associated with blocks of size X r . Then, the 
functional q^[q] coincides with the dynamical functional C^[C]. 

This relationship (at this point purely kinematical) between powers of static and dy- 
namical order parameters holds only for 'fixed point' values of C. The values of q that are 
not contained as entries of the ultrametric matrix correspond to values of C intermediate 
between fixed points, i.e. within discrete scales 0; for these auto-correlation values there is 
no replica counterpart within the ultrametric ansatz. 



2 Let us note, in passing, that the correspondence we have just described is an example of a more 
general connection between static replica and dynamic SUSY treatments. Indeed this connection 
holds not only for powers of the order parameters, but for a wide class of functionals H[Q] p2| . 
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A. SK Model 



For the SK problem in zero magnetic field 0, the solution of the mean-field dynamical 
equations yields a dense set of fixed points of f(C,C) in the interval [0, g^], plus an iso- 
lated fixed point C(t,t) = 1. The value qEA is the Edwards- Anderson parameter, and the 
interval {qEA-, 1] corresponds to the 'FDT' (discrete) scale. For times associated with auto- 
correlations in this interval Xd{C) = 1 and FDT holds. Instead, for large times associated to 
C in [0, Qea] i FDT is modified as in Eq. ( |IH.2| ) by a non-trivial factor A^[C]. The function 
Arf[C] is part of the solution to the mean- field equations of motion. 



To obtain the explicit form of the powers Q k it is useful to separate the FDT discrete 
scale writing Q(l,2) as 

Q(1,2) = Q FDT (1,2) + Q(1,2). (III.9) 
The FDT term QfdtO-i 2) has entries that satisfy 

c FDT {hM) = c FDT (ti - 1 2 ) , (lino) 
G FDT {t l M) = dCFDT t~ t2) • (in.ii) 

The function C F dt(j), t = ti—t^-, is a rapidly (with respect to the variation of Q) decreasing 
function; CVdt(O) = 1 — qEA and Cedt(oo) = 0. It is the output of the Sompolinsky- 
Zippelius dynamics 'within a valley' 0. Operator powers of Qedt have entries that verify 
Eqs. ( [III.10I) and ( [III. lip and are relevant in the same time-region. 

The Q function varies slowly; C(ti,£i) = qEA and C(ti,tf) = if t\ » tf. 

3 This solution has been obtained for T slightly below the critical temperature T c . We expect it 
to hold for all temperatures below T c . 
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In the operator product Q FDT Q, the operator Q FDT acts as the identity 5(1 — 2) times 



1 - Qea 3 1 



The separation ( |ill.9| ) is the dynamic counterpart of the separation of the - static - replica 
matrix Q ab , 

Qab = (1 - q E A)Sab + Qab (111.12) 

where Q a b has q F A m the diagonal. 

In order to compute X^ h > we use that, for long times, 



1=0 



\ 1 / 



J (12 Q^ T (l,2) S'(2,3) 



= Q" FDT (1, 3) + ((1 - q EA )S + a)" (1. 3) - ((1 - 5m)«S)*(1, 3) . (111.13) 

This relation allows to write \C^ k \ G^}, the entries of Q k , in terms of |g^, t , G^ OT j and 
{0^,0^}, the entries of Q l FDT and Q', respectively. 

In Appendix A we give expressions for the entries C FF)T and G FD . T of Q k FDT - The explicit 
form of Cpl) T (ti, t-i) has no analog in the ultrametric ansatz for the replica approach, except 
for the values at equal times and at times such that C = qEA (ie. at the limits of the FDT 
'discrete' scale). Cp DT is also a rapidly decreasing function which falls from (1 — q F A) k at 
equal times to zero at widely separated times. 

In Appendix B we calculate the entries and of Q k for large times. 



Using these results we are in a position to express C^ k > and G^ for all ranges of times: 



For large and widely separated times ti,t 2 such that C(ti,t 2 ) < qEA, we compute the 
sum in Eq. ( |111.13| ) to get, in terms of G(ti,t 2 ), 

[l- qEA -F[0}) k -(l-q EA ~F[C}) k 



G (fc) [G] 



X M dx> 



X\0] x 



i2 



X[C] 

(1 - q EA - F[C(x')]f - (1 - q EA - F[0))' 



(111.14) 
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and 



Gtofat*) = X d [C] dC 2 (C) . (111.15) 



For large and close times such that C > (Jea 



C (k \t u t 2 ) = C^Ut, - t 2 ) + C {k \q~ EA ) , (111.16) 
G^\t u t 2 ) = dCik }^ h \ (111.17) 



with C^(q EA ) from Eq. iim . 



In particular we shall need the result for equal times 

C«(ti,ti) = (I - q EA ) k + C {k \q EA ) . (111.18) 



IV. EXPRESSIONS FOR THE STAGGERED AUTO-CORRELATION 



Expressions (|LH.17|) and ( |111.18| ), together with ( [111.14] ) and ( |111.15| ) are all that is needed 
to calculate the staggered auto-correlation and response functions at long times. In order 



to make contact with the results of Ref. |T(J we make a change of variables: 



A[X d ] = F[0] - F[C(X d )} 6(X M - X d ) 
I = F[0}+q EA 



(IV. 1) 
(IV.2) 



where X M = X d [q EA }. 

Inverting equation ( |[L22|) , using ( |II.20| ) and the low-temperature phase result (3(1 — 1) 
1, after some algebra we obtain the staggered auto-correlation at long equal times 



g(X) ee lim lim g(X,t,t) 

t^oo N— >oo 



(3(2 - X) 



1 + 



dX d 
o X d 



WA(X d )f 



\(l + /3A(X d )) + (l + /3A(X d ))* 
14 



(IV.3) 



The staggered auto-correlation g(X,C), between two large and widely separated times t\,t2 
chosen such that C(t 1 ,t 2 ) = C < (Jea is given by 

g(X,C)= lim lim g(X,ti,t 2 ) 

ti-»oo,C(ti,t 2 )=C N-*x 



9(A) ' 



m - a) 
+ 



\ , (1-/3(1-<M) ; 



l-A/3(l-g^)+/3 2 (l-g £yl ) 2 
x di c) \1 - X(l + (3A(X' d )) + (1 + (3A(X' d )y 



(IV.4) 



Both these last expressions are valid for the low-temperature phase. 

We now note that for the SK model the functions Xa{C) for the dynamics and the 
usual function X(q) of the replica treatment coincide at all temperatures. Furthermore, 
the diagonal values Q k aa and C^ k \ti,ti) also coincide. This also implies the equality of the 
functions A and /. 

Hence, we have just proven that for the long and equal times the dynamic staggered spin 
auto-correlation (ttV.31) coincides with the static one obtained in Ref. [ECO]. 



Furthermore, the staggered auto-correlation g(X, C) coincides with the static one com- 
puted with configurations belonging to two equilibrium states with mutual overlap C. 

Finally, let us show that, both statically and dynamically, g(X) contains all the informa- 
tion needed to reconstruct P()(q). To this end we define 

s uiuy (IV . 5) 

and 

h(X)=P(2-X)g(X)-l. (IV.6) 



4 One can extend the equilibrium calculation of Ref. [1C] to this case by considering the entry 
of the replica matrices (1 — + ^Q 2 )^ 1 ab corresponding to a pair of replicas having mutual 
overlap Q a b = C. 
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The functions t(X) and q(X) both have a plateau for the same values of X 6 (Xm, 1)- 
Equation ([LV.3|) becomes 

h(X) = t d 4 ^ + (± ~ • (IV.7) 



A" 2 t(X) - A \X U ) t(X M ) - A 
Having excluded the plateau in t(X), we can change variables in the integral to obtain 

M A) = ['" (IV.8) 



t' — X \X M ) tu — X 

where t M = t{X M ) and //(*) = (t - 2)X- 2 (t) dX/dt. 

This is an electrostatic problem with positive charges. The determination of /j,(t),XM, tu 
can in principle be done in a unique way: the analytical continuation of h(X) from the interval 
— 2 < A < 2 yields the 'charge density' //(£), the magnitude of the 'discrete charge' and its 
position t M . 

The knowledge of //(£), Xm^m then allows to calculate X(t) as 



Hence, we have shown that g(X) contains all the information needed to obtain X(q). 



V. NUMERICAL SIMULATIONS 



We have performed Montecarlo simulation of the dynamics of a system with iV = 996 
spins at temperature T = 0.3. 

We have calculated the distribution of overlaps for two copies of the system relaxing from 
different initial configurations, at times t = 600, 2000, 10000 Montecarlo sweeps. At these 
times the system is well out of equilibrium as shown by the form of the overlap distribu- 
tion. This eventually takes the form of the static P(q) (except for finite-size corrections) at 
equilibrium, but is only bell-shaped at the times considered (see Fig. 1). 
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Figure 1. Overlap distributions for t = 600,2000, 10000 Montecarlo sweeps. The dashed 

line shows the analytical equilibrium P(q). 



Figure 2 shows the equal-times staggered auto-correlation times the density of eigenval- 
ues, p(X)g(X, t, t), at times t = 600,2000, 10000, together with the analytical result for the 
equilibrium p(X)g(X). We notice that the convergence to a curve that coincides with the 
equilibrium one is very fast, even in a situation manifestly out of equilibrium (cfr. Fig.l). 

In particular, the time dependent energy density is given by 



Hence, the equivalence lim^oo g(X; t, t) = g(X) ensures the equivalence of the asymptotic 
energy and the equilibrium one, a result that we have also checked numerically 

Figure 2. The equal-times staggered auto-correlation distribution g(X;t,t) times the 
density of eigenvalues p(X), for t = 600 (diamonds), t = 2000 (crosses) and t = 10000 
(squares) Montecarlo sweeps. The continuous line shows the analytical result for the 



The partition function of the SK model is dominated by the low-lying states. The out of 
equilibrium dynamics never reaches any of these states: there is never a situation of 'effective' 
dynamical equilibrium in which the system is trapped forever in one of these states ignoring 
the rest of the phase-space and satisfying FDT and time-translational invariance. 

Indeed, as time passes, the top evolution of the system slows down more and more but 
it is never completely trapped. In Ref. || it was pointed out that the equality Pd(q) = P(o) 




(V.l) 



statics and for long but finite times. 



VI. DISCUSSION 
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implied that an infinite SK system has an energy density which goes asymptotically to the 
equilibrium energy density. Furthermore, the 'width' of the region in which the system has 
a fast relaxation at long times coincides with the 'size' qEA of the equilibrium states. 

This already points to a similarity between the long-time landscape and the (different) 
region that dominates the partition function. The results in this paper suggest that this 
similarity is much deeper: Consider the relaxation at two large times (ti,t 2 ). Because of 
weak ergodicity breaking fl4[], given t\ we can always choose t 2 > ti such that the auto- 



correlation C(t 2) t\) between the configurations &i{ti) and <Ji{t 2 ) at those times is any given 
value C. If we now compute the staggered auto-correlation distribution g(X,t\,t 2 ) for those 
configurations we obtain the same distribution we would have obtained with configurations 
chosen from two equilibrium states at mutual distance C. 

This result is quite surprising, since we know that the system is not in any equilibrium 
state at times t\ or t 2 , however long; it will eventually leave the neighbourhood of tx^ (ti) and 
CTj(t 2 ) never to return. 

If we now keep the configuration at times t 2 and let the system evolve up to a time £3 
such that again C(t 2 ,t 3 ) = C we obtain the same form for the staggered autocorrelation 
g(X, t 2l t 3 ). Note however, that because the system slows down, t 2 — t\ < t 3 — t 2 if C < qEA- 

The picture that this seems to suggest is that the geometry of phase space seen at 
different long-times is similar in every respect, except that the relevant barriers found at 
larger times are higher, thus slowing down the system. 

We expect that this similarity between the equilibrium and the long-time out of equilib- 
rium regions of phase-space will hold for models that do not have a 'threshold' level below 
which the system cannot go. More precisely, we expect this similarity to hold for models 
with a continuous set of correlation scales; e.g. the SK model and the model studied in Refs. 
IK?]], but we do not expect it hold in the p-spin spherical model of Ref. 

Finally, let us remark that the good agreement between the numerical calculation of 
g(X, t, t) for large t and the static g(X) constitues a rather detailed test of the solution of the 



out of equilibrium dynamics for this model [[15 



Appendix A 



In this appendix we give an expression for Q FDT . Let us first note that the power of a 
FDT - supersymmetric - operator is itself FDT [|ll|]. From Eq. (|II.14|) we then have 



C_fdt(^i ~~ ^3) — C ( FDT '(ti — t 2 ) CpDri^ ~ t 2 ) 

+ f dt 2 c FDT {t 2 - 1 3 ) dc ^i - 1 2 ) {A1) 

Jtz Of 2 

Beacause the time-difference t\ —t 3 is in a one to one relation with Cfdt^i — ^3)5 Eq. ( |A.1|) 
proves Eq. (|III.3|) for the FDT regime. 



The value of Gp DT (t\ — t%) is obtained as 

G% T (ti ~ h) = d °™f t l ~ h) • (A.2) 

This says that X k) = 1 for C in the FDT regime, and hence is of the form (|IIL5| ). 

In this paper we only need the value of Cp^ T (ti,ti) = Cpjj T (0). This is easily obtained 
by putting i 3 = t\ in Eq. ( |A.1|) . In this way we obtain 

tfSr(Mi) = [CpDT^ht = (1 - q EA ) k . (A.3) 
From ( |A.l ) it is easy to see that Q FDT is also small for very different times. 



Appendix B 

In this Appendix we analyse the properties of Q k for long and widely separated times, 
for which Q = Q though Q k ^ Q k . We first study Q k and then the properties for Q k will 
follow from linearity (see Eq. (|111.13| )). 



We analyse C^ k \ and F^ k \ We first demonstrate by induction that depends 
exclusively on C 
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C^ k+1 \t 1 ,t 2 )=C^ k+1 \C(t 1 ,t 2 )). (B.l) 

Then we show also by induction that the relation between and C( fe+1 ) maintains the 

form ( |111.5| ); there exist F( k+1 ^ and X^ +l ^ that verify 



6 <«> ((1 , (2) = °niM = xnc{tut2)] '^MA . (B . 2) 

Finally we explicitly compute , and in terms of C for the SK model. The 
are defined up to a constant, we fix it by imposing F( fc )(C(ti,ti)) = (e.g. for jfe = 1, 
F(q EA )=0). 

Let us define the (rather badly behaved) 'inverse' of / 

(B.3) 

The function / is written in such a way that its second argument is always smaller than the 
first one. 

We start by assuming 

C<*»(*i,t 2 ), =C<"(C(ti,t 2 )) (B.4) 
5W(il , (2 ) = g£!»^)] = x« [C *)( (l , i2) ] *^ , (B.5, 



with F( fe )[C (fc) (ti,ti)] = 0. Eq. finD then reads 



C (fc+1) (ti,t 3 ) = -C (fc) [C(ti,0)] F[C(t 3 ,0)] - / dy ^-M F [f( C ,y 

j cits ,0) °y 



+ dy p k \y)} 7(y, C) (B.6) 



c 



where C = C(t\, t 3 ). 

It is easy to see that, for all / such that f(x,y) oc y, C(ti,0) = =>- C^ fc ^(ti,0) = 0, V/c. 
In these cases C( fc+1 ) reads 
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C"=«»(C) = - [dy F [7(C »)] + jf % Af » [C«M] ^> 7( C , „) 



+ / dyX« [C<*>(y)] ?^Mf{y,C). (B.7) 



c 



This is a time-reparametrization invariant equality and depends on t\ and £3 only 
through C. 



We now demonstrate that Eq. ( |B.2| ) holds V/c. Eq. ( L1.15|) implies 



G^ + %,t 3 ) = £ ^ [C^QiM p [f { e {tl , h ),C(ti,h))] (B.8) 

CI3 Jt 3 at 2 

Then, we can identify 

F (fc+1) (ti,t 3 ) = t dt 2 dFik) [ C * fc) fc'* 2 >] F [J (^,^,£(^3))] (B.9) 
choosing the integration constant to be zero. Now, using C ( - k \ti,t 2 ) = C^ k \C(ti, t 2 )) 

ni , t ^J-\ y ^^^ Fmc)] . (B , 0) 

The rhs only depends on C and then F^fats) = F^ k+1 \C ik+1) ] and J^ fc) (*i,* 3 ) = 
^(fe+i)p(fc+i)j 

The derivation up to this point is general, it only depends on the assumptions of Ref. 
0. For the SK model C(ii,0) = for long enough time t\ and the ultrametric dynamical 
relation between auto-correlation functions 

70, y) = min(x, y) = y (B.H) 

holds [§. Then C^(t u 0) = 0, VA; and 

C {k+1 \C) =~f dy (^^F[y]+FW [C^(y)] \ . (B.12) 

We can also solve Eq. (|B.10|) using the ultrametric relation ( B.ll|) . We obtain 
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F (k) p k )(C)] = _(_F[C]) fc (B.13) 
We now solve Eq. ( P.12|) for C^ k+1 \ Its derivative w.r.t. C is 

O^^.^. (B.14) 
Using Eq.( p.l3 | ) we get the recursive equation 

+ 1 (B.15) 
with io® = (-F[C)) k - 1 dC (k \C)/dC. The solution is 

^1 = k {-F[C]f-' (B.16) 

We now obtain xf\C {k \C)} in terms of X d [C]. Derivating Eq. ( |B~T3l) w.r.t. C 

xf\ C M{C)\ = k {-F[C]) k - 1 X d [C] (B.18) 

and inserting the result in Eq. ( [B.16|) we obtain 

Xf ) p k \C)\=X d [C\. (B.19) 



We have obtained these results C^ k ' = C^ k \C) and Eq. (|B.19|) for the powers Q k . Since 



these hold for every power k and C^ k ' is a linear combination of these powers (see Eq. 
( [llLT3|) ) we have proven Eqs. ( pip and ||Lg ). 
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